perm filename LIGHT.RE3[2,JMC] blob
sn#096150 filedate 1974-04-08 generic text, type T, neo UTF8
\\M0NGR25;\M1BDI25;\F0
Draft for comments: This paper is in the file LIGHT.RE3[2,JMC]@SAIL
It was solicited as a review by the AI Journal.
Artificial Intelligence: A General Survey by
Professor Sir James Lighthill, FRS, in \F1Artificial Intelligence: a
paper symposium\F0, Science Research Council 1973
\J Professor Lighthill of Cambridge University is a famous
hydrodynamicist with a recent interest in applications to biology.
His review of artificial intelligence was at the request of Brian
Flowers, head of the Science Research Council of Great Britain, the
main funding body for British university scientific research. Its
purpose was to help the Science Research Council decide requests for
support of work in AI. Lighthill claims no previous acquaintance
with the field, but refers to a large number of authors whose works
he consulted though not to any specific papers.
Unfortunately, workers in artificial intelligence lose
intellectual contact with Professor Lighthill almost immediately,
because he defines the field in such a way as to exclude our most
important research goals. He does this by classifying work in
artificial intelligence into three categories A, B and C. A stands
for \F1advanced automation\F0 which he likes, C stands for
\F1connections\F0 to psychology and neurophysiology which he also
likes, and B stands for \F1bridge\F0 between the other two and also
for \F1building robots\F0 both of which he doesn't like. The term
\F1robot\F0 is defined in an idiosyncratic way to refer to any
computer program or device which is neither aimed at an application
nor intended to model the brain. He then states that activities in B
can be justified only in so far as they make a connection between A
and C.
Lighthill's ABC classification seems to exclude the
possibility that there can be a science of intelligent behavior that
can be studied apart from applications and apart from biology.
However, for almost all workers in the field, the whole idea of
artificial intelligence is that the relation between problems and
problem solving methods and the relation between situations and the
behavior that will achieve goals can be studied by theory and
computer experiment as an independent subject.
He makes no argument for his classification, and gives no
hint that anyone may think differently. This is somewhat puzzling
since a number of the documents submitted by British AI workers for
his consideration are quite explicit about the point. Perhaps
ignoring this claim plays a tactical role in justifying his proposal
that basic experimental research in AI be abandoned, because if AI
research has scientific problems of its own, they should be pursued
even though the level of funding may depend on the prospects for
results at the present level of knowledge and talent. Whereas if the
research is only a means toward solving some other scientific or
practical problems, then the subject may be abandoned if there are
more promising ways of solving the other problems.
Having ignored the possibility that AI has goals of its own,
Lighthill goes on to document his claim that it has not contributed
to applications or to psychology and physiology. He exaggerates a
bit here, it seems worthwhile to spend some effort disputing his
claims that AI has not contributed to these other subjects.
In my opinion, AI's contribution to practical applications
has been significant but so far mostly peripheral to the central
ideas and problems of AI. Thus the LISP language for symbolic
computing was developed for AI use, but has had applications to
symbolic computations in other areas, e.g. physics. Moreover, some
ideas from LISP such as conditional expressions and recursive
function definitions have been used in other programming languages.
However, the ideas that have been applied elsewhere don't have a
specifically AI character and might have been but weren't developed
without AI in mind. Other examples include time-sharing, the first
proposals for which had AI motivations and some techniques of picture
processing that were first developed in AI laboratories and have been
used elsewhere. Even the current work in automatic assembly using
vision might have been developed without AI in mind. However, the
Dendral work has always had a specifically AI character, and many of
the recent developments in programming such as PLANNER and CONNIVER
have an AI motivation.
AI's contributions to neurophysiology have been small and
mostly of a negative character, i.e. showing that certain mechanisms
that neurophysiologists propose are not well defined or inadequate to
carry out the behavior they are supposed to account for. I have in
mind Hebb's proposals in his book \F1The Organization of Behavior\F0.
No-one today would believe that the gaps in those ideas could be
filled without adding something much larger than the original work.
Moreover, the last 20 years experience in programming machines to
learn and solve problems makes it implausible that cell assemblies
\F1per se\F0 would learn much without putting in some additional
organization, and physiologists today would be unlikely to propose
such a theory. However, merely showing that some things are unlikely
to work is not a \F1positive\F0 contribution.
I think there will be more interaction between AI and neurophysiology
as soon as the neurophysiologists are in a position to compare
information processing models of higher level functions with
physiological data. There is little contact at the nerve cell level,
because, as Minsky showed in his PhD dissertation in 1954, almost any
of the proposed models of the neuron is a universal computing element,
so that there is no connection between the structure of the neuron and
what higher level processes are possible.
On the other hand, the effects of artificial intelligence
research on psychology have been larger as attested by various
psychologists. First of all, psychologists have begun to use models in
which complex internal data structures that cannot be observed
directly are attributed to animals and people. Psychologists have
come to use these models, because they exhibit behavior that cannot
be exhibited by models conforming to the tenets of behaviorism which
essentially allows only connections between externally observable
variables. Information processing models in psychology have also
induced dissatisfaction with psychoanalytic and related theories of
emotional behavior. Namely, these information processing models of
emotional states can yield predictions that can be compared with
experiment or experience in a more definite way than can the vague
models of psychoanalysis and its offspring.
Contributions of AI to psychology are further discussed in
the paper \F1Some Comments on the Lighthill Report\F0 by N. S.
Sutherland which was included in the same book with the Lighthill
report itself.
Systematic comment on the main section, entitled \F1Past
Disappointments\F0 is difficult because of the strange way the
subject is divided up but here are some remarks:
1. Automatic landing systems for airplanes are offered as a
field in which conventional engineering techniques have been more
successful than AI methods. Indeed, no-one would advocate applying
the scene analysis or tree search techniques developed in AI research
to automatic landing in the context in which automatic landing has
been developed. Namely, radio signals are available to determine the
precise position of the airplane in relation to a straight runway
which is guaranteed clear of interfering objects. AI techniques
would be necessary to make a system capable of landing on an
unprepared dirt strip with no radio aids which had to be located and
distinguished from roads visually and which might have cows or
potholes or muddy places on it. The problem of automatically driving
an automobile in an uncontrolled environment is even more difficult
and will definitely require AI techniques, which, however, are not
nearly ready for a full solution of such a difficult problem.
2. Lighthill is disappointed that detailed knowledge of
subject matter has to be put in if programs are to be successful
in theorem proving, interpreting mass spectra, and game playing. He
uses the word \F1heuristics\F0 in a non-standard way for this. He
misses the fact that there are great difficulties in finding ways of
representing knowledge of the world in computer programs and much AI
research and internal controversy are directed to this problem.
Moreover, most AI researchers feel that more progress on this
\F1representation problem\F0 is essential before substantial progress
can be made on the problem of automatic acquisition of knowledge. Of
course, missing these particular points is a consequence of missing
the existence of the AI problem as distinct from automation and
study of the central nervous system.
3. A further disappointment is that chess playing programs
have only reached an "experienced amateur" level of play. Well, if
programs can't do better than that by 1978, I shall lose 250 pounds
and will be disappointed too though not extremely surprised. The
present level of computer chess is based on the incorporation of
certain intellectual mechanisms in the programs. Some improvement
can be made by further refinement of the heuristics in the programs,
but probably master level chess awaits the ability to put general
configuration patterns into the programs in an easy and flexible way.
I don't see how to set a date by which this problem must be solved in
order to avoid disappointment in the field of artificial intelligence
as a whole.
4. Lighthill discusses the \F1combinatorial explosion\F0
problem as though it were a relatively recent phenomenon that
disappointed hopes that unguided theorem provers would be able to
start from axioms representing knowledge about the world and solve
difficult problems. In general, the \F1combinatorial explosion\F0
problem has been recognized in AI from the beginning, and the usual
meaning of \F1heuristic\F0 is a device for reducing this explosion.
Regrettably, some people were briefly over-optimistic about what
general purpose heuristics for theorem proving could do in problem
solving.
Did We Deserve It?
Lighthill had his shot at AI and missed, but this doesn't
prove that everything in AI is ok. In my opinion, present AI
research suffers from some major deficiencies apart from the fact
that any scientists would achieve more if they were smarter and
worked harder.
1. Much work in AI has the "look ma, no hands" disease.
Someone programs a computer to do something no computer has done
before and writes a paper pointing out that the computer did it. The
paper is not directed to the identification and study of intellectual
mechanisms and often contains no coherent account of how the program
works at all. As an example, consider that the SIGART Newsletter
prints the scores of the games in the ACM Computer Chess Tournament
just as though the programs were human players and their innards were
inaccessible. We need to know why one program missed the right move
in a position - what was it thinking about all that time? We also
need an analysis of what class of positions the particular one
belonged to and how a future program might recognize this class and
play better.
2. A second disease is to work only on theories that can be
expressed mathematically in the present state of knowledge.
Mathematicians are often attracted to the artificial intelligence
problem by its intrinsic interest. Unfortunately for the mathematicians,
however, none of the nicely mathematical theories with good theorems
such as control theory or statistical decision theory have not yet
turned out to be relevant to AI. Even worse, the applicability
of statistical decision theory to discriminating among classes of
signals led to the mistaken identification of perception with
discrimination rather than with description which so far has
not led to much mathematics.
3. Every now and then, some AI scientist gets an idea for a
general scheme of intelligent behavior that can be applied to any
problem provided the machine is given the specific knowledge that a
human has about the domain. Examples of this have included the GPS
formalism, a simple predicate calculus formalism, and more recently
the PLANNER formalism and perhaps the current Carnegie-Mellon
production formalism. In the first and third cases, the belief that
any problem solving ability and knowledge could be fitted into the
formalisms led to published predictions that computers would achieve
certain levels of performance in certain time scales. If the
inventors of the formalisms had been right about them, the goals
might have been achieved, but regrettably they were mistaken. Such
general purpose formalisms will be invented from time to time, and,
most likely, one of them will eventually prove adequate.
However, it would be a great relief to the rest of the workers in AI
if the inventors of new general formalisms would express their
hopes in a more guarded form than has sometimes been the case.
4. At present, there does not exist a comprehensive general
review of AI that discusses all the main approaches and achievements
and issues. Most likely, this is not merely because the field
doesn't have a first rate reviewer at present, but because the field
is confused about what these approaches and achievements and issues
are. The production of such a review will therefore be a major
creative work and not merely a work of scholarship.
4. While it is far beyond the scope of this review to try
to summarize what has been accomplished in AI since Turing's 1950 paper,
here is a five sentence try: Many approaches have been explored and
tentatively rejected including automaton models, random search,
sequence extrapolation, and many others. Many heuristics have been
developed for reducing various kinds of tree search; some of these are
quite special to particular applications, but others are general.
Much progress has been made in discovering how various kinds of
information can be represented in the memory of a computer, but
a fully general representation is not yet available. The problem
of perception of speech and vision has been explored and recognition
has been found feasible in many instances. A beginning has been made
in understanding the semantics of natural language.
John McCarthy - 9 March 1974